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Abstract 

Motivated by the Hankel determinant evaluation of moment se- 
quences, we study a kind of Pfaffian analogue evaluation. We prove an 
LC/-decomposition analogue for skew-symmetric matrices, called Pfaf- 
fian decomposition. We then apply this formula to evaluate Pfaffians 
related to some moment sequences of classical orthogonal polynomials. 
In particular we obtain a product formula for a kind of q-Catalan Pfaf- 
fians. We also establish a connection between our Pfaffian formulas 
and certain weighted enumeration of shifted reverse plane partitions. 

1 Introduction 

The Hankel determinants of Catalan numbers have drawn the interests of 
many researchers with relations to the combinatorial arguments of lattice 
paths in recent years (see, e.g., [2j [51 El [11] [131 Ell 125]). It is well-known that 
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if {n n } n >o is the moment sequence of certain orthogonal polynomials, the 
Hankel determinant det ( Mi+7-2 ) have a nice formula because of the 

\ ' l<ij'<n 

classical theory of orthogonal polynomials (see [13] )• In this paper we would 
like to exploit a Pfaffian analogue of this kind of Hankel determinants. 

We say a matrix A = (a})ij>i (resp. A = (a))i<i,j< n ) is skew-symmetric 
if it satisfies a? = —a* for i,j>l (resp. 1 < i,j < n). If we are given an 
n x n skew-symmetric matrix A = {a l j)i<i,j<n where n is an even integer, 
then the Pfaffian of A (see [23 denoted by Pf A, is defined to be 

Pf (A) = *2, • • ■ , (T n -i, cr n ) o%... aZ~\ (1.1) 

where the summation is over all partitions a = {{a"i, o"2}<, • • • , {c'n-i? °n}<} 
of [n] := {1, 2, . . . , n) into 2-elements blocks, and where e(<7i, <t 2 , . . . , c n _i, <r n ) 
denotes the sign of the permutation 



1 2 • ■ ■ n — 1 n 

01 cr 2 ■•• cr n -l <* n 



1.2) 



and we use the notation [n]. A partition a of [n] into 2-elements blocks is 
called a perfect matching or a 1-factor. 

As most of the orthogonal polynomials have their g-analogues, in order to 
propose a Pfaffian analogue of the above Hankel determinants of moments, we 
have the ordinary version and g-version. More precisely, we propose Pf ((j — 
i) /ii + j +r -2) x<i j <2n as a Pfaffian analogue of the above Hankel determinants 
of the moments fi n , and for a g-analogue of fi n (q) of \x n we take 

where r is a fixed integer. We mainly investigate the case where \i n is the 
moments of the little g-Jacobi polynomials in this paper. Throughout this 
paper we use the standard notation for g-series (see [U H]): 

(a; <?)oo 



(a;?)oo = JJ(1 - ag fc ), (a;q) n 



k=0 (aq n ; qU 

for any integer n. Usually (a; q) n is called the q-shifted factorial, and we 
frequently use the compact notation: 

(ai, a 2 , • • • , a r ; q)^ = (ai; q)oo(a2] q)oo • ■ • (a r ; q)oo, 
(ai, a 2 , • • • , a r ; g) n = (a^ g) n (a 2 ; g)„ ■ ■ • (a r ; g) n . 
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The r +i4>r basic hypergeometric series is defined by 



r+Wr 



di, 02, • • • , O r +l 



g,z 



E(ai, a 2 , . . . , a r +ij g)n 



n=0 



(g, fix,..., 6 r ;g), 



The iittie q-Jacobi polynomials [HI [19] are defined by 



p n (x;a,b;q) 



(a6g n + 1 ;g) t 



;-i)V 



'2^1 



g n , a&g 
aq 



q, xq 



;i.3) 



which are orthogonal with respect to the inner product defined by 



^ = (ag; g)oo (&g; g)A 
(abq 2 ;q)oo ^ (g;g) fc 



;i-4) 



The moments of the little g-Jacobi polynomials are defined by 

(a?; g)n 



//„ = (x n , 1) 



(abq 2 ; q) n 



71 = 0,1,2,... . 



The main results on Pf ( (g* 1 — g J 1 )/ij +? _ 2 ) are stated in Section [31 

V / l<«,j<2n 

To prove the Pfaffian identities we employ an LU -type decomposition 
of a skew-symmetric matrix, which we call a Pfaffian decomposition. In 
Section [2] we state this decomposition and give a proof by using a Pfaffian 
analogue of the Desnanot-Jacobi adjoint matrix theorem Theorem 3.12]. 
In Section H] we give a proof of our main results stated in Section [3J We 
prove the Pfaffian decomposition in Theorem 13. II by reducing the single sum 
obtained as the matrix multiplication to the g-Dougall formula (I4.10p for 
a terminating very- well-poised 605 series (see |H Ej). As a byproduct of 
the proof we obtain the Pfaffian decomposition of another skew-symmetric 
matrix stated in Theorem | 



As an application of our main results in Section [3] and Section [4j we 
obtain a formula for weighted enumeration of shifted reverse plane partitions 
in Section We consider a special family of shifted reverse plane partitions 
and give weights that resembles to the weight in the inner product (jl.4p to 
profiles of shifted reverse plane partitions in the family (see (15 .4p and (I5.20p ). 
Then Corollary 13.21 (resp. Corollary I4.4p gives the weighted enumeration of 
the family of shifted reverse plane partitions whose number of rows are even 
(resp. odd). 
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In Section O we state several conjectures for this type of Pfaffians. One 
may ask what is the relation between our Pfaffians and the classical theory 
of orthogonal polynomials. At this point we have no answer to the question 
why the Pfaffians factors into nice linear factors from the view point of the 
classical theory. 

Finally, in Appendix we state our second proof of the main results in 
Section H] using Zeilberger's creative telescoping. We see that the certificates 
are simple, and we can prove the formulas by hand. 

2 Pfaffian decomposition 

First we recall the reader a well-known decomposition of a matrix. Let 
A = ((ij)i,j>i be a matrix (of finite or infinite row/column length). If / = 
{ii, . . . ,i r } (resp. J = {ji, . . . ,j r }) are a set of row (resp. column) indices, 
then we write A 1 , = A 1 ?''"' 1 ? for the r x r submatrix obtained from A by 
choosing the rows indexed by I and columns indexed by J. Let a 1 -, = al 1 ''"' l J 
denote det Aj if \I\ = \J\ > 0, and 1 if / = J = 0. The following identity is 
known as the Desnanot-Jacobi adjoint matrix theorem [7J Theorem 3.12] 

det AM det 43 

= ^t 4:*] ; ::; det 4^: - det a^j-- 1 det 4:£„ r (2.1) 

The following proposition is usually called the /^-decomposition of a matrix. 
Usually /^-decomposition means L is lower unitriangular and U is upper 
triangular. But here we adopt the style of L.D [/-decomposition where both 
of L and U are (lower or upper) unitriangular and D is diagonal because of 
Theorem 12.21 If A is an n x n matrix of rank n, then, by elementary linear 
algebra, we can deduce that there is an n x n permutation matrix P such 
that det (Py4)|*J ^ for any i — 1, . . . , n. Although this permutation matrix 
P is not unique, the triple (L, D, U) in the following theorem is unique for 
chosen A and P. But this is the most general case, and in many applications 
we can choose P to be the identity matrix I n . We give a proof here to make 
this paper more comprehensive and as a warm-up for the succeeding proof 
of Theorem 12.21 

Proposition 2.1. Let n be a positive integer, and A = {a l j)i<i,j< n be an 
n x n matrix of rank n. If we choose an n x n permutation matrix P such 
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that det (PA)f*| 7^ for 1 < i < n, then PA is uniquely written as 

PA = LDU, (2.2) 

where D = (rfi<5pi<ij< n is a diagonal matrix, L = (lj)i<i,j< n is a lower 
unitriangular matrix and U = (^j)i<i,j<n is an upper unitriangular matrix. 
In fact 

" det(PA)!::;]' ' <_t(P_)g] ' 1 det(P_)[J| 

Here the Kronecker delta 5* takes the value 1 if i = j, and otherwise. 

Proof. We may assume P — I n without loss of generality, and we have to 
show that a l A is uniquely written as a* = X^fc_=i ^k^k u j with l\ = u\ = l for 
1 < z < n. This is trivial if n — 1. Assume n > 2 and this is true for all 
1 < i, j < n — 1. If 1 < i < n, then must satisfy 



i_i [fc-i],i [fc] 

i _ V- %\ >-l],n 

n Z__ [fc] ^ 1 



[fc-1] [fc] 
fc=l a [fc-l] a [fc] 



But this can be obtained from 

i-l [k-l],i [k] [i] 

i sr^ a ik] a [k-iu , a w 

Z__ Jk-1] [k] ^ [i-l] 
fe=l u [fc-l] u [fc] u [i-l] 

by replacing z'th column by nth column of A, and we obtain dj = afi_.ii J a [i-i| • 

Hence we derive u l n = a £_.i] re / a m> an d vice versa. Similarly, when 1 < j < 
n — 1, we can show that is determined uniquely and given by the above 
formula. Thus it is enough to prove the formula for % = j — n, which implies 

n-l n [k-l],n n [k] 

U [k] U [fc-l],n 



U n ___ [fc-1] [fc] ^ n ' 

k=l a [k~l] a [k] 

By induction hypothesis 



n - 2 Jfc-l],n-l [fc] [n-l] 

n-l _ %] Q [fc-l],n-l Q [n-1] 

l n-l [fc-1] [fc] ^ [n-2]' 
fc=l fl [fc-l] a [fe] 



which implies 



Hence 



E 



[k-l],n [k] [n-2],n 
l [k] a [k-l],n _ a [n-2],n 



[fc-1] [k] [n-2] 
fc=l a [fc-l] a [fc] fl [n-2] 



n _l [fe-l],n [k] [n-2],n [n-2],n [n-1] 



E 



a [k] a [k-l},n _ a [n-2],n _ fl [n-l] a [n-2],n 
[fc] ~~ [n-2] [n-2] [n-1] : 



fc=l fl [fc-l] a [fc] a [n-2] a [n-2] fl [n-l] 

which equals by (12. ip . Conversely, if we take d n = then 

it clearly satisfies the above equation and gives the L[/-decomposition of A. 
□ 

The fact that each entry of L, D and U is expressed with certain type of 
minors of A appears in [23] related to the Painleve equations. Although we 
can use this decomposition even in the case where A is a skew-symmetric 
matrix, it seems more consistent to consider the decomposition in the follow- 
ing theorem in which each entry is expressed with subpfaffians. This type of 
decomposition also seems important with relation to the integrable systems 
(see [1]). Let us start with some definitions. 

We define 2x2 skew-symmetric matrix J2 by 



Jo 



1 
-1 



and let J2 n = J2 ® • • • © J2 denote the 2n x 2n matrix whose main diagonal 
2x2 blocks are all J2 and the other blocks are 2x2 zero matrices O2. Note 

that l J2nJ2n = ^2n- 

For a skew-symmetric matrix A, we usually take I = J so, hereafter, we 
write Aj = i ilri ^ for A\. Further let ai = ai lt __^ r denote Pf Aj if / 7^ 0, 1 if 
7 = when there is no fear of confusion. Then the Pfaffian analogue of the 
Desnanot-Jacobi adjoint-matrix theorem (12 .ip reads as follows (see pT5| [TT] ) : 

*^[n— 4]Q[n] (^[n— 4] ,n— 3,n— 2<3[ n -4],ra-l,n (2.3) 
— 0[n-4],n-3,n-lO[n-4] ,n— 2,n + CL[n-4],n-3,n a [n-4],n-2,n-l- 

The following theorem gives so-called Pfaffian decomposition of a skew- 
symmetric matrix A. 
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Theorem 2.2. Let n be a positive integer, and A = (api<j .j<2n be a skew- 
symmetric matrix of size 2n. If apj] 7^ for 1 < i < n, then A is uniquely 
written as 

A = *VTV. (2.4) 



Here T and 1/ are composed of 2 x 2 blocks 



T 



(T x 2 
2 T 2 

\0 2 2 



2 \ 

2 



T 



V 



(h v 2 

2 J 2 

\o 2 2 



V 

v. 



n 
n 



J,) 



of the form T~ 



u 
-u 0, 

1 < i < j < n, where each ti and vf (i) is defined by 



for 1 < i < n, and VJ 



«S-i(0 ^ 



a 



[2*: 



d[2i-2] 

for 1 < % < n and 1 < k, I < 2n. 



a [2i-2],k,l 
0[2i] 



for 



(2.5) 



Before we proceed to the proof of the theorem, we illustrate the de- 
composition by an example. If we take a 4 x 4 skew-symmetric matrix 
A = (oy)i<i,j<4, then the above decomposition is given by 



T 



( a l2 

-an 



\ 






^ 











(11234 




H1234 

012 


J 



V 



/ 1 213 £14 \ 

' Qi2 Q12 

_2 Q Q23 £24 

Qi2 ai2 

1 

V 0-1 / 



where a. 



1.1 



Pf 



a) 
-a) 



a* and 01234 = Pf A. 



Proof of Theorem 12.21 First we write the matrix A by 2 x 2 blocks as 



A 



A\ A\ 



Al 



\ai a- ... 
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fa 2i ~} a 2i r l \ 

where A\ is the 2x2 block matrix A 1 - = [ 3? 1 \- for 1 < i, j < n. 

3 3 \ a l-i a % J ~ 

Hence the decomposition (12 .4p is equivalent to 

min(i,jr) 

A)= % k T k V!* (2.6) 

k=l 

with VI = Ji- We proceed by induction on n. If n = 1, then ( 12 .6p implies 
T = T\ = A\ = A and V = V± = J 2 so that the existence and uniqueness are 
trivial. Assume n > 2, and our claim holds for n — 1. That is, the equations 
(12. 6p for 1 < i,j < n uniquely determines all T, and V- for 1 < i,j < n and 
each entry is given by (12. 5p . This implies that 

t-i / \ 

«[2fc-l],2i-l«[2fc-2],2fc,2i «[2fc-2],2fc,2i-lCi[2fc-l],2j \ G[2i] 2 j-l 



E 

fc=i 



0[2fc-2]0[2fe] a[2fc-2]fl[2fc] / <2[2i-2 



«2i 



holds for 1 < i < n from (I2.6p . Replacing (2z — l)st row/column by rth 
row/column and 2ith row/column by sth row/column in this identity, we see 

/ 0'[2k-l],rO'[2k-2},2k,s G[2fc-2] ,2fc,r^[2fc-l] ,s \ «[2i-2],r,s _ ^ r ^ ^\ 

~^ V «[2fc-2]0[2fc] Ct[ 2 fc_2]a[2fc] / «[2i-2] 

holds for any r and s. From computation of each entry of the equation (12. 6p . 
we see that v r s (1 < i < n, r — 2i — 1, 2i, s — 2n — 1, 2n) must satisfy 



s 

i-l 



E 

fc=l 



0>{2k-V\,r a {2k-2\,2k,s a \2k~2].2k,r a \2k-l],s \ a \2i] r r 

1 I LJ -f 1 = a„. 



a[2fc-2]a[2fe] a[2fc-2]0[2fc] / api-2] 



Comparing this equation with (12. 7p . we see that v r s in (I2.5P is the unique 
solution of this equation. Similarly, from computation of each entry of the 
equation (I2.6p . t n must satisfy 

n-l / \ 

G[2fc-l],2n-l a [2fc-2],2fe,2ra Q.[2fc-2] ,2fc,2n-lO[2fc-l] ,2n \ , + _ 2n-l 

" ^2n 



/ "^2fc-lJ,2n-l L ^2fc-2J ! 2fc,2n "[2ifc-2J,2fe,2n-l"[2fc-l],2n \ ^_ 
V «[2fc-2]0[2fc] 0[2fe-2]«[2fc] 



Substituting i — n— 1, r — 2n — 1 and s = 2n into (12.71) . we obtain 

n-2 

E 



fc=i 



0[2A;-l],2n-l a [2fc-2],2fc,2n «[2fc-2],2fc,2n-lO[2fc-l],2n \ a [2n-4],2n-l,2n _ 2n-l 

1 _ °2n • 



fl[2fc-2]«[2fc] 0[2fc-2]a[2fc] / 0[2n-4] 
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Hence we have 

_ 0[2n-4],2n-l,2n 0[2n-3],2n-lO[2n-4],2n-2,2ra 0[2n-4],2n-2,2n-lO[2n-3],2n 
t n — r • 

0[2n-4] 0[2n-4]«[2n-2] G[2n-4] «[2n-2] 

Thus, by ( 12. 3ft . we conclude that t n in ( 12.5ft is the unique solution of this 
equation, and this proves the theorem in the case of n. □ 

This theorem shows that, if we obtain a guess for each entry of T and V, 
then, by uniqueness of the decomposition, it is enough to prove the matrix 
multiplication, which is equivalent to the single sum 



E {vf-^hvfik) - vf{k)t k vf-\k)} = a] 



k>l 



From (I2.5P it is enough to guess a formula for the subpfaffians apt-iy and 
0[2i-2],2jj for any row/column indices i and j. 

By the uniqueness of L[/-decomposition ( 12. 2 p and Pfaffian decomposition 
( 12. 4p . the L[/-decomposition and the Pfaffian decomposition are, in a sense, 
equivalent. We can get the L£7-decomposition from the Pfaffian decomposi- 
tion, and vise versa. If we put P = (pj)i,j>i, where 



Pi 




if i is odd, 
if i is even, 



which is the permutation matrix corresponding to (12) (34) . . . , then it is easy 
to see that det (PA)[{1 ^ for % > 1. If we put J = @ J 2) then U = *JV is 

upper unitriangular, D = PT = P f JT J is diagonal, L = P f V J P is lower 
unitriangular, hence 

PA = LDU (2.8) 
gives the /^-decomposition. Each entry of the matrices U = { u }) i j >1 , L = 

K)ij>i and D = (^^)^>i is s iven °y 

-Vj +1 if i is odd, _ f -t(i+i)/ 2 if i is odd, 

' f* -1 if z is even, 1 ij/ 2 if i is even, 

^ v\ +1 if i is odd and j is odd, 







v\_ x if z is even and j is odd, 



v i+1 if i is odd and j is even, 
if % is even and j is even. 
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For later use we cite the minor summation formula of Pfaffians here: 

Theorem 2.3. ([TU [15]) Let n < N be positive integers and assume n is 
even. Let T = (^)i<i<n,i<j<7v be an n x N rectangular matrix, and let 
B = (b'j)i<i,j<N be a skew symmetric matrix of size N. Then we have 

PfOB/)det(Tf ] ) = Pf(Q), (2.9) 

IC[N] 

where the skew symmetric matrix Q = (Q)) = TB*T of size n whose entries 
are given by 

Q)= b i det ( T ki)> (l<*,J<n). (2.10) 

l<k<l<N 

When n is odd, we can immediately derive a similar formula from the 
case when n is even. 

Proposition 2.4. Let {atk}k>i be any sequence, and let n be a positive 
integer. Set B = (bj)ij>i to be the skew-symmetric matrix defined by 

oti if j = i + 1 for i > 1, 
b) = <j -aj if i = j + 1 for j > 1, (2.11) 
otherwise. 

If / = (21, . . . , 22n) is an index set such that 1 < z'i < • • • < i^n, then 

Pf (Br) = I ^fc=i a *™-i ifi2fc=i2fc-i + lforfc = l,...,n, 
otherwise. 



3 A Pfaffian analogue of g- Catalan Hankel 
determinants 



Let us write 



{abq 2 ; q) i+j+r -2 



for i,j > 1, and let A denote the skew- symmetric matrix 

A = (4L>! 
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of infinite degree. Then the following theorem gives the Pfaffian decomposi- 
tion of A. 

Theorem 3.1. Let A be as above, and let 

t = a i-l g (i-D(i+r) (gj l)i+r(k; g)»-l 

(abq 2 \ q) 2i+ r-i(abq i+r ] g)*_i ' 



o* if z is odd, 
e* if z is even, 



where 



f- l ;q)i (a ? i+r+1 ;g) i _ i _ 1 



(g;^ (a^+r+i;^.^' 

i = (g^gMg^^g)^ _ (aq i+r ;q)j-if(hj,r) 

6j q (g;g)<-i ' (abq 2l+r ~ 3 ;q) 1 (abq 2i+r - 1 ;q) J ^ i+1 



with 



f(i,j,r) = (1 - g^Xl - ag i+ '- 1 )(l - abq i+ ^- 2 )/{\ - q) 

+ aq 2i+T -\l - 6)(1 - g j_m ). (3.2) 

If we put T = (_ ^ and V = ( V j) . then 

A = Vry (3.3) 

gives the Pfaffian decomposition of A. 

An immediate consequence of the theorem is the following corollary. 
Corollary 3.2. Let n > 1 and r be integers. Then we have 

1 ( Q g' g)»+j+r-2 



Pf (g- 1 - g 



(abq 2 ;q) i+j+r _ 2 J 1 



<i,j<2n 

n-1 



a „(„-l) „(„-l)(4n + l)/3+n(n-l> TT (6g; g ) 2fc ff fa gU-lfog; gWr-1 _ ,3^ 

J = l fc=l («V;g)2(fc+n)+r-3 
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In fact, we obtain a more general formula from Theorem 13. 11 If A is as above 
and m is a positive integer, then the following identities hold: 

Pf (A [2n _ 1]:m ) = a n(n-l) q n{n-l)(4n+l)/3+n(n-l)r 



x (g m 2n+1 ;q) 2 n-i(aq;q)m+r-i jr (bq; g) 2 fc(g; g) 2 fc-i(ag; gWr-i ^ ^ 



(a&g 2 ; g) m+2n+r „ 3 ^ (abq 2 ; q) 2 (k+n) 



+r-3 



Pf (A 2n _ 2] , 2n , m ) = a^- 1 )g^- 1 )^ +1 )/ 3+ "("- 1 ^ +1 /(2n,m,r) 

(g m " 2n ; g)!(g m - 2n+2 ; g) 2ri _ 2 (ag; g) m+r _i ^ (6g; g) 2fc (g; g) 2 *-i(ag; g) 



(abq 4n+r 3 ;q) 1 (abq 2 ;q) m+2n +r-2 ^-=1 (<% 2 ; g) 2 ( fc +n)+ 



n 



2 fc+r-l 



r-3 



(3.6) 

where f(i,j,r) is defined by (13 .2|) . 

Next we consider a specialization of Corollary 13.21 If we put a = q a and 
b = qP and let g — >• 1 in (13. 4ft . then we obtain the following corollary: 



Corollary 3.3. Let n > 1 and r be integers. Then we have 



[a + l) i+J - +r _2 



(0 + /3 + 2), 



«+i+r-2/ i<ij<2n 

n— 1 n 



fc=l fc 

where we use the notation 



i (a + P + 2) 2 (fc +n ) +r _3 



a 



nr=i(« + ^- 1 ) ifn>0, 
l/Iltiitt + ^^-l) ifn<0. 



An almost equivalent result is obtained in [T51 Theorem 6], which is mo- 
tivated by work in In [B] Ciucu and Krattenthaler use a special case 
of this Pfaffian for application to certain exact enumeration of lozenge tiling. 
Further, if we put a = — | and (3 = | in (13 .7p . then we obtain 



Pf ( (j - i)C i+j+r _ 2 _ 

n-1 



TT (4fc + l)! " (2fc-l)!(4fc + 2r-2)! 
11 (2fc)! l = l(2fc + r-l)!{2(fc + n)+r-2}!' 1 J 



fc=i 
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where C n = — tt ( 2n ) denotes the Catalan numbers. On the other hand, if we 

" n+l \n J ' 

put a = — ~ and j3 = —\ in (13. 7p . then we obtain 



Pf((j-*)c£--t 

l<«,i<2n 



n-l 



tt WlTT (2fc-l)!(4fc + 2r-2)! 
. = i ( 2A; ) ! fci (2^ + r - l)!{2(fc + n) + r - 3}!' { } 



k 

where = ( 2 ^) is usually called the central binomial coefficients. 
The Laguerre polynomials (see [19] ) are defined by 



which are orthogonal with respect to the inner product 

1 

T(a + 1 



(/>#> = tv \ in / e x x a f(x)g(x)dx. 





Note that 

Pf(QC i a})l< i j<2„. = Ci . . . C 2 „,Pf(a})i<ij<2n- (3.10) 

Multiplying by /3™(2n+i)+n(r-2) and then i etting p _^ ^ we get t h e 

following result. 

Corollary 3.4. Let /x n = (a + l) n for n > 0, which is known to be the 
moment sequence of Laguerre polynomials. Then we have 



Pf 



n 

({j-i)u. i+j+r _ 2 ) =TT(2A;-l)!(a + l)2fc + r-i. (3.11) 

V / Ki,j<2n 

k=l 



The Hermite polynomials (see [19]) are defined by 

■n/2,-(n-l)/2 1 



H n (x) = (2x) n 2 F 
which are orthogonal with respect to the inner product 



,r 2 



i r 

J-< 



e x f{x)g{x) dx. 



Substituting a = \ in (13. lip we get another remarkable formula. 
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Corollary 3.5. Let /i n = Ofc=o(^^ + •"•) denote the double factorial of 2n + 1 
for n > 0, which is known to be the moment sequence of Hermite polynomials. 
Then we have 

1 n 

pf ((j - i)^ +i+r -2) = ^ - 2 ) n ( 4A; + 2r - i ) n - ( 3 - 12 ) 

fc=l 



4 Proof of Theorem 3.1 



Let a*, tj and t>* be as in Theorem 13.11 To prove (13. 3p . it is enough to show 

£ W^^-i^f - = «} (4.1) 

fc>i 

for z, j > 1. Replacing ag r by a, we may assume r = hereafter without loss 
of generality. Hence (14. ip is written as 

a 2(fc-i) 2(fc-i)(2fc-i)+i _ (q l ~ 2k+2 ; q)2k-2{q j ~ 2k+2 ] q)2k-2 



{aq 2k ; q)i- 2 k{aq; q)j-i{bq; q) 



2(fc-l) 



(a6g 2fc 1 ;q) 2 k-i(abq ik 1 ; q)i_ 2 k+i(abq 2 ; q) j+2 k~2 
. |(l _ - g^- 2fc )(l - abq l+2k - 1 )f{2k,j, 0) 

- (1 - ^- 2fc )(l - g J '- 2fc+1 )(l - a^ +2fe - 1 )/(2fc,z,0)} 

Replacing 2/c — 1 by fc, we obtain 

y> afc _i fc (fc-i)+i _ (afeg 2fc ; q)i{abq 2 ] gjfc-ggg, g j ~ fc+1 , g J '~ fc+1 ; gQfc-i 
^ (q,aq,abq i+1 ,abqj +1 ;q) k 



k>l 
k odd 



v /• ■ . x ag; q) i+j -2{abq 2 ] q) i - 1 {abq 2 ] g r i 

x g k (i,j;a,b,q) = — r r , 4.2 

(ag; g)i-i(ag; q)j-i{abq 2 ] q) i+j -2 

where gk(hj] a, g) is set to be 

g k (ij;a : b,q) = (1 - g fe )(l - ag fc ) 

x |g- fc (l + a&g 2fe )(l + abq 1 ^' 1 ) - ab(l + q) (g*" 1 + g^ 1 ) } 

+ aq k ~\l - b) (1 - g'~ fc ) (l - g J " fc ) (l - abq 2k+1 ) . (4.3) 
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By numeric experiments we observe that (14.21) also holds in the case where 
the sum in the left-hand side runs over all nonnegative even integers k, i.e., 

fc( fc _i)+i _ (abq 2k ; q)i(abg 2 ; g) fe - 2 (6g, <f~ fc+1 , q>- k+1 ; q) k -i 
^ (q,aq,abq i + 1 ,abqi +1 ;q) k 

k even 

x 9l (i,r,a Aq ) = <^^W«^«)h , (4.4) 
(aq; q)i-i{aq; q) j ^ 1 {abq 2 ; q) i+j ~2 

By adding or subtracting (14.21) and (I4.4p . these two identities are equivalent 
to 

V^ fl fe-i fe(fe-i)+i (abq 2k ; q) 1 (abq 2 ; q) k ^ 2 (bq, <f^+\ g^ k+1 ; g) k ^ 
^ (q,aq,abq i+1 ,abqi +1 ;q) k 

v /. • 7 \ 2(ag; q) i+j _ 2 {abq 2 ; q) i - 1 {abq 2 ; 

x g k {i,j;a,b,q) = — r ? r , 4.5 

(ag; g)i_i(ag; q) i _ 1 [abq l \ q) i+j -2 

and 

y^(_!)fc a *-i ? *(fc-i)+i . («V fc ; g)i(Q^ 2 ; qh-^bg, g l ~ k+1 , g j ~ k+1 ; g) k -i 
^ (g,ag,abg i+1 ,abgi +1 ;g)' 



k>0 



k 



X g k (i,j;a,b,q) = 0. (4.6) 

To prove ( 14. 5ft we rewrite g k (i,j;a,b,q) as follows and apply g-Dougall for- 
mula, i.e., Lemma [4.1[ to each term, then a direct computation leads to the 
desired identity: 

g k (i,j; a, b, g) = q+^q + aq^)(l - q k )(l - q^l - abq k )(l - abq k+1 ) 
+ q'^aibq - ab - 1 + 6)(1 - q i+j ) + (1 - a)(q - ab) 

+ a(l + bq){\ - g*)(l - ^) + (1 + atf+^Xl - g)(l - a&g)}(l - q k )(l - 

+ aq k -\l - b){\ - abq){\ - q l )(l - q j ). 
To prove ( 14. 6p . we generalize this identity as 



\k n k-l n k(k-l)+l 
k=0 

< (1 - abq 2k )(abq 2 ; q) k _ 2 {bq, cq~ k+l , dq~ k+1 ; q) k -{g k {a, 6, c, d, q) 

(q, aq, abeq, abdq; q) k 
a m c m d m (l - abq 2m+1 )(abq 2 ; q) m -i(bq, q/c, q/d ; q), 



{—q) m (q, aq, abeq, abdq ; q) 7 



(4.7) 



15 



where 



g k (a,b,c,d,q) = (1 - g fc )(l - aq k ) 

x jg~ fc (l + abq 2k ){\ + abcdq' 1 ) - a&g _1 (l + q)(c + d) J 
+ ag fc_1 (l - 6)(1 - cg~ fe )(l - dg" fe )(l - abq 2k+1 ). 



(4.8) 



Then (14. 7p is proven by induction on m. This completes the proof of Theo- 
rem inm 

Lemma 4.1. Let m be an integer. Then we have 



k—mk{k—m) 
tij q 



k>m 



(g*-™+ 1 ,^-™+ 1 ) 6 g ;g) m _ 1 . 



1 - abq 2k ){abq 2 ]q) k+m _ 2 {bq,q i k+1 ,q j fc+1 ;g) fc -i 
(g; q) k - m (aq, abq i+1 , abqi +1 ; q) k 

(aq 3+1 \ q)i- m (abq 2 \ g)j_i 



(ag; q) i (abqi +l ]q) i 



(4.9) 



In fact (14. 9p reduces to the g-Dougall formula (Jackson's formula) jU 
12.3.2)], P (2.4.2)] 



6<?5 



i i i -n 

a, gaa, — ga2,o, c, g 
as, — aa , ag/o, ag/c, ag" 



ag 



n+l 



(aq,aq/bc; q) n 
{aq/b, aq/c; q), 



(4.10) 



by the substitution 



a <r- abq 2m , b <- bq 



c<- q m J , n <- i — m. 



Remark 4.2. The lemma also directly follows from the Bailey pair (a n ,f3 n ) 
given by 



a. 



0n 



(o,6,c; g) ra (l-ag 2 ")(ag/fe)"(-l)"g(2) 
(q,aq/b, aq/c; g) n (l - a) 
(ag/fcc; q) n 



(g, ag/6, ag/c; g) n 
Here a pair (a n , /3 n ) is said to be a Bailey pair j4] if it satisfies 

n 

Oik 



fc=0 



(q;q) n -k{aq;q) 71+ fc 
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In fact we prove two identities (14.21) and (14. 4p in this section. While (14.21) 
is used to prove Theorem 13.11 one may ask what's ( I4.4p for? In fact we 
can interpret (I4.4p as a Pfaffian decomposition of another skew-symmetric 
matrix. Define a* for i,j > by 

a o = (Q&g r ~ 1 ;g)i(ag;g)j+^i , 4 n * 

3 aq r (l - b){abq 2 ;q) j+r ^ 
with a l = — a°, a° = and ( 13. ip for i,j > 1. 

Theorem 4.3. Let A = {a))i,j>o where a* is as above. Let U, Oj and e* be 
as in Theorem 13.11 and we put 



3 



o l j if i is even, 
Cj if i is odd. 



If we S et T = f_° M and V = (t3}) then 
i>0 ^ y 

I=*T/TV (4.12) 
gives the Pfaffian decomposition of A. 

Corollary 4.4. Let n > 1 and r be integers. Then we have 

pf ( n i\ - n n(n-2) n(n-l)(4n-5)/3+n(n-2)r 

x tt (q;q)2k(aq;qhk+r(bg; qhk-i , 4 13 x 

J-l (afeg 2 ; g) 4fc+r _ 1 (a&g 2fc+r ; g) 2 fc-i ' 



fc=0 



Let P n}r (a,b] q) denote the right-hand side of (I4.13p . Then, more generally 
we have 

Pf /T \ (9 m ~ 2n+1 ; g)2n- 2 (ag 2n+T - 1 ; g) m -2n p , , , 

Pf ^4[0,2n-2],m-lJ = (g;9)2ra _ 2(Q ^-3 ;g)m _ 2rt *V(«, M), 

(4.14) 

(g m " 2n ; g)i(g m ~ 2n+2 ; g^N 2 "^- 1 ; g) m -2n 

^ [ °' 2n - 3] ' 2n - 1 ' m "V 9 ' (g; qhn-2(abq^-s. q)l{abq ^ +r - 3 . q)m _ 2n+i 

x /(2n - 1, m - 1, r)iV(a, 6; g). (4.15) 

Here we use the notation [z, j] = { x G Z | z < x < j }. 
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5 Weighted enumeration of shifted RPPs 



In this section we give an application of Corollary 13. 2\ which enumerates a 
certain class of shifted reverse plane partitions. 

Definition 5.1. A shifted reverse plane partition (abbreviated as shifted 
RPP) is an array 7r = (ity) of nonnegative integers, defined only for % < j, 
that has nondecreasing rows and columns, and that can be written in the 
form 

7Tn 7Ti2 7Ti3 TTx^ 

^22^23 7T2,A 2 + 1 

: : .- ' ( 5 - 1 ) 

where 

(i) Ai > A 2 > ■ ■ ■ > A n > 0, 

(ii) TTjj < ^ij+i whenever the both sides are defined, 

(iii) iiij < fti+ij whenever the both sides are defined. 
Further, if tt also satisfies 

(iii') 7r,j < Tii+ij whenever the both sides are defined, 

then it is called column-strict shifted reverse plane partition or a shifted 
tableau. The entries tt^ are called the parte of ir. To each shifted reverse 
plane partition ir we assign the weight \n\ = tt^ to be the sum of parts. 
The strict partition A is called the shape of tt, and the nondecreasing sequence 
(7rii> 7T22, • • • , 7i"nn) is called the profile of ir. Let denote the set of all 
shifted reverse plane partitions of shape A and profile /i, and ^ iAt the set of 
all shifted tableaux of shape A and profile [i for fixed A = (Ai, . . . , A n ) and 
fi = (fix, . . . , fi n ) with Ai > • ■ • > A n > and < fix < ■ • • < fin- 
Fox example, 
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2 
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is a shifted tableau of shape A = (11, 8, 6, 3) and profile fi = (0, 1, 3, 5) with 
weight 69. If is a family of shifted reverse plane partitions, then the 
generating function of & is defined to be 

GF[^] = £gW. (5.2) 

Let n(A) = J2i>i(^ ~ It is easy to see that 

GF[^]=g B(A) GF[^] 1 (5.3) 

where e n = (0, 1, . . . , n — 1) and v = (v>i, is 2 , . . . , z/ n ) is a profile such that 
v \ < ^2 < ■ ■ ■ < v n . Let ^ n denote the set of profiles v — (z/ 1; . . . , z/ 2n ) such 
that < z/i < z^2 < • ■ ■ < ^2n and z^fc = z^fc-i for k = 1, . . . , n. For z/ e & n 
and iGZwe let 

w *( u ) = H ) 11 f fl 2 fc -i.^ — > ( 5 - 4 ) 

k=l ^ ' ^Mfc-l 

where |z/| = X]fc=i y fc- Let ^'n = { v + e 2n | v e ^ n }, and 

^)=(^) (M ^n^^ (5.5) 

fc=i D^k-i 

for e Now we are in position to state our main theorem in this section. 
If the shape A = (Ai, A2, ■ ■ ■ , A r ) is in the form of A = (m, m — 1, . . . , m — r+1) 
for positive integers m > r, then it is called staircase. Each of (13. 4p . (13. 5p 



Figure 1: Nearly Staircase Shapes 

and (13. 6p corresponds to each of (15. 6p . (15. 7p and (I5.8P below. In fact the 
leftmost diagram in Figure [1] gives the case of m = 5, n = 2 in (15. 6p . and the 
middle (resp. rightmost) diagram in Figure [1] gives the case of I — 8, m — 5, 
n = 2 in ([577]) (resp. (Oil ). 
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Theorem 5.2. Let r be an integer. For any positive integers m and n such 
that m > 2n, we fix the shape A = (m, m — 1, . . . , m — 2n + 1) of length 2n. 
Then we have 



£ W r -2(»-2 B )-lMGF[^,J 



_ / (a&g 2 ;g)oo ) n tt (g;g)fc-i A (ag;g) 2 fc+r-i , . 

I (ag;g)oo J ^ (g; g) fc+m -2n-i ^ (a&g 2 ; g) 2 (fc+n)+r-3' 

More generally, if A = (I, m — 1, m — 2, m — 3, . . . , m — 2n + 1) where / > m, 
then we have 



^ I N;?)oo J 



/(afcg 2 ; g^l" (g^ m+1 ;g) 



j yj2n-l 



(g;g) 



x TT (gj g)fc-l _ (agj g)l-m+2n+r-l _ TT ( a gi g)2fc+r-l ,g ^ 

^ (g;g)fe+m-2n-l (a6g 2 ; g)/- m +4n+r-3 (^g 2 i g) 2(fc+n)+r-3 ' 

and if A = (I, m, m — 2, m — 3, . . . , m — 2n + 1) where I > m, then we have 

^r-2(m-2n)-l( z/ ) GF[^ x ,u] 

_ [ (q^g 2 ; g)oo ] " (g'" m ; g)i(g ; " m+2 ; g) 2 n- 2 Ifi^g; gO*^ 
I («g;g)oo J (g;g);-i(g;g)m-i Ilfc=7 2 (g;g) fe+m— 2n— 1 

x (agj g)t- m+2 n+r-i/(2ra, l-m + 2n,r) (aq; q) 2k +r-i ^ g s 

(a6g 4n+r '- 3 ; q) 1 (abq 2 ; g) z _ m+4n+r _ 2 ^ (a&g 2 ; g) 2 (fc+n)+r-3 ' 

To prove this theorem, we first recall the notation of the lattice path 
method, which is due to Gessel and Viennot [10]. Let D = (V,E) be an 
acyclic digraph without multiple edges. If u and v are any pair of vertices, let 
2? (u, v) denote the set of all directed paths from u to v. For a fixed positive 
integer n, an n-vertex is an n-tuple of vertices of D. If u = (ui, . . . ,u n ) 
and v = (vi, . . . ,v n ) are n- vertices, an n-path from u to v is an n-tuple 
P = (Pi, . . . , P„) such that Pj G ^ (uj, u^), z = 1, . . . , n. The n-path P = 
(Pi, . . . , P n ) is said to be non-intersecting if any two different paths Pj and Pj 
have no vertex in common. We will write (u, v) for the set of all n-paths 
from u to v, and write ( w , for the subset of (u, v) consisting of non- 
intersecting n-paths. If u = (ui, . . . , u m ) and v = (vi, . . . , v n ) are linearly 
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ordered sets of vertices of D, then it is said to be D -compatible with v if 
every path P G 2?{ui,vi) intersects with every path Q G ^(uj, Vk) whenever 
i < j and k < I. If n G S n , by v n we mean the n-vertex (iV(i), • • • , ^(n))- The 
weight w(P) of an n-path P is defined to be the product of the weights of its 
components. Thus, if u = (ui, . . . , u n ) and v — (v\, . . . , v n ) are n- vertices, we 
define the generating functions F(u, v) = GF (it, i;)] = J2pe,9>(u v) W (P) 
and Fq(u, v) = GF [& (it, v)] = J2pe^ ( u «) W (-P)- In particular, if it and t> 
are any pair of vertices, we write 

h(u, v) = GF (u, v)] = w ( p )- 



Lemma 5.3. (Lindstrom-Gessel-Viennot [10J) 

Let u = (iti, . . . , u n ) and v — (v±, . . . , v n ) be two n- vertices in an acyclic 
digraph D. Then 

^ sgnvr F (u n ,v) = det[h(u u ^■)] 1 < iJ < n . (5.9) 

In particular, if w is D-compatible with v, then 

F (it, v) = det[h(ui, v 3 -)]i<ij<n- (5.10) 

Using the Lindstrom-Gessel-Viennot theorem, we obtain the following 
determinantal expression for the generating function of shifted tableaux. 

Lemma 5.4. Let A = (Ai, . . . , A„) and \x = (/xi, . . . , fi n ) be sequences such 
that Ai > ■ ■ ■ > A„ > and < jii < ■ ■ ■ < fi n . Then 

• (5.H) 

[Q\ q)Xi-l/ l<i,j<n 

Proof. We consider the digraph D whose vertex set is Z> and the edge set 
is defined as follows. An edge is directed from it to v whenever v — it = (1,0) 
or (0, 1) (resp. whenever v — u — (1, 0)) if the vertex u = satisfies i > 
(resp. % = 0). For it = we assign the weight g J (resp. 1) to the edge 

with v — u = (1,0) (resp. (0,1)). Fix a sufficiently large positive integer 
N. For given A = (Ai,...,A n ) and /i = (/i 1; . . . , /i n ), we set the vertices 
it, = (0,/ij) and Vj = (Xj,N) for i,j = 1, . . .,n. Let denote the set of 
shifted tableaux tt G ^a )(U such that each part is less than or equal to N. 
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(0,Mr) 



(0,M2) 
(0,Ml) 



(A r ,JV) 



(A 2 ,iV) (Ai.AT) 



•LT J 



Figure 2: The n-path corresponding to the above shifted tableaux 



Then a tableau ir e is interpreted as an n-path P from u = . . . , it n ) 
to v — (vi, . . . , v n ). For instance the shifted tableaux in the above example is 
pictorially illustrated by the 4-path in Figure 121 If u — (0, y) and v = (x, N), 
then we have h(u,v) = q xy [ x ~ 1 a ?~Jl~ y ] ■ Hence, by Lemma 15.3} we obtain 



GF = det e 



Xi-l + N- Hj 
Ai-1 



9 / Ki,i< 



3Sn 



Letting N — > oo, we obtain the desired identity (15. lip . 



□ 



Proof of Theorem 15.21 In fact ( 15. 6ft is equivalent to the following identity 
from ( 15. 3ft : 



ro(n— 1) mn+n(n— 2)(4n— l)/3+n(n— l)r 

f {abq 2 ;q) 

tit q 



oc 
oo 



2n 

n 



I (ag;?) 



(g; g)2fc-i(«g; g) 



J (g; g) 



fe+m— 2n- 



1 fe=i ii W;g) 



2fc+r-l 



i gj2(fc+n)+r-3 



(5.12) 



Now the entries of the skew-symmetric matrix in Corollary 13 . 21 can be written 

as 



a) = (q 



i-l 



q J 



(a6g 2 ;g)oo (ag 



i+j+r 



;g)oo 



i+j'+r— 1 . 



;g)c 
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If we apply the g-binomial theorem [HJ (1.3.2)] 

oo 

E 

then we obtain 



{a;q)k k _ (ax;q) c 



k=0 



(q;q) k (x;q) c 



(5.13) 



(aq; q) c 



(a6g 2 ;g)oo ^ (g;g) fc 
q)k 



(a6g 2 ;g)oo ^ (g;g) fc 



g(i+s-l)(fc+l) „(i+s-l)fe 



where s is any integer. Hence we obtain 

(?;?), [ Q } 



k=0 



q (i+s-l)k q (i + s-l)(k + l) 



{<i;q)i+s-2 (q;q) i+s -2 
q (j+s-i)k ? y +s _i)(fe+i) 



(abq 2 ;q), 



(q;q)j+s-2 (q-,q) j+B - 2 

(aq; q) i+ j +r - 2 



q % 1 — g- 7 1 



<?)oo (g; g)i+ s - 2 (g; g)i+«-2 (afrg 2 ; q)i+j+ r -2 ' 



(5.14) 



Set i*- and aj to be 



q 



(i+s-l)j 



(q;q) 



(bq; q) 



3 (aq r - 2s+1 Y 



i+s-2 



q) j 



for i > 1 and j > 0. Let B = (/3])i j>o be the skew-symmetric matrix defined 
by 

a,i if j = % + 1 for % — 0, 1, . . . 
/3] = ^ — «j if % — j + 1 for j = 0, 1, . . . 
otherwise. 



If we take T = (i})i<i<2n,o<j 
Proposition I2.4[ we obtain 



and 5 = (/3j)ij>o i n Theorem I2.3[ then, by 



fc =i 



l<i,j<2n 



(5.15) 
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where the sum on the left-hand side runs over all 2n-tuples fi = (fii, /i 2 , . . . , /U. 2n ) 
of integers such that < fii < /i 2 < • ■ ■ < H2n and fi 2 = £*i + l r • • , 
^2n = H>2n-i + 1- Now we take the shape A = (m, m — 1, . . . , m — 2n + 1) for 
positive integers m, n such that m > In in Lemma 15.41 Then (15. lip implies 
that GF [3T x ,n] equals 

det( q -— =(-irdetM- (5.16) 

V [QiQjm-i / l<i,j<2n \ W) i+m— In— 1 / l<i,j<2n 

for a profile /i = (/ii, . . . , /i 2n ) where < /ii < • • • < /i 2n . Here the right-hand 
side is obtained from the left-hand side by reversing the order of row indices. 
Let s = m — 2n + 1. If we substitute (15 . 1 6[) into (I5.15P and use Corollary 13.2 [ 
then we obtain 



— 1 A^fc — 1 



2)1 



q ns f (Q^ 2 ;g)oo l n TT L_ 

I (og; g)oo J ^ (g; g)fc+, 

n(n-l) n(n-l)(4n+l)/3+n(n-l)r TT I '7 1 „. „\ TT (?) gOgfc— lCggj ffW 



hs-2 
n-1 



XQ _ ^n(n-l)(4. + l)/3 + „(n-l)^ (6g . g)2fc ^W^ 

fe=l fe=l \ a 1 iQ) 



2(fc+n)+r-3 



This proves (15.121) . If we put /i = ^+e 2n and use the fact that n(\) = mn(2n— 
1) — |n(2n — l)(4n — 1), then we can prove (I5.6P by a direct computation. The 
other identities can be proven similarly. The details are left to the reader. □ 

Theorem 15.21 treats only reverse plane partitions whose number of rows is 
even. We obtain the case where the number of rows equals 2n — 1 from 
Corollary 14.41 Let A = (aj)o<i,j be the skew-symmetric matrix whose (i, j)- 
entry for < i < j equals 



(aq;q) 



j + r — 1 



a 



(abq 2 ;q) 



j + r-1 



if i = and j > 1, 



Then it is easy to see that Corollary 14.41 implies that for n > 1 

'o<i,j<2n-l 



pf _ fl (n-l) 2 n(n-l)(4n-5)/3+(n-l) 2 r 



(aq;q)r yr (gj g) 2 fc(ag; gWr-Qg; q) 2 k-i ^ ^ 

(abq 2 ; q) r AA (a&g 2 ; g) 4fc+r ._i(a6g 2fc+r ; g) 2fc _i ' 
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Let P njr (a,b; q) denote the right-hand side of (15.171) . Then, more generally, 
from (I4.14p and (I4.15P we derive for n > 2 

Pf = [q . qhn _ 2(abq ,» + r-, q}m _ ln P«Ml). (5.18) 



Pf (i[o ,2n— 3],2n— l,m— l) — 9 ' 



( g m-2n. g)i(gm -2n+2. g ) 2n _ 3 ( ag 2n+r-l. 



(q; qhn-2(abq 4n+r - 5 ; g) 1 (a6g 4 "+ r " 3 ; q) m - 2n +i 
x /(2n - 1, m - 1, r)P n , r (a, 6; q). (5.19) 

As an application of (I5.17p . (I5.18P and f)5.19p . we can derive a similar iden- 
tities in the case where the number of rows of the shapes is odd. Before we 
state our theorem we need a few definitions. Fix positive integers n and t 
such that 1 < t < n. Let denote the set of profiles v = (z/ l5 . . . , u 2n _i) 
such that < V\ < v 2 < ■ ■ ■ < v 2n ~\^ v ik = v 2k-\ for k = 1, . . . , t — 1 and 
v 2 k+i = tyk f° r k = t, . . . , n — 1. For v G i?™'* and x, y G Z we let 

Vf» = (a^) (|i/| -^- l)/2 (agT"- 1 

(bq 2 *- 1 -^)^ npj- gg^gW^ inr (bq 2k ;q)„ 2k 

where |z/| = X^&=i Then we obtain the following theorem from (I5.17p . 
|Q5| and (15391 - 

Theorem 5.5. Let r be an integer. For any positive integers m and n such 
that m > 2n — 1, we fix the shape A = (m, m — 1, . . . , m — 2n + 2) of length 
2n — 1. Then we have 



E, r+nw (6?;g)a(t-i) /(*) / \r>x? 

(ag ^ (Fad u ^ ^MH^)» GF 



jl-MtL.^(a,M), (5.21) 



where 



i2 (a kg) - / ( a&g2;g )°° j" ( Q g'g)»- TT (aq;q) 2k+r 
n ' r ' ' I (aq;q)oo J (abq 2 ;q) r fj- 



(a&g 2 ; g) r ^ (afeg 2 ; g) 4fc+r _i(a6g 2fc+r ; <?) 2 fc-i 
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More generally, if A = (I, m — 1, m — 2, m — 3, . . . , m — 2n + 2) where / > m 
and n > 2, then we have 



(959) 



(5.22) 

and if A = (I, m, m — 2, m — 3, . . . , m — 2n + 2) where / > m and rt > 2, then 
we have 



(9; 9) 

_ f(2n - 1, j - m + 2n - 1, r) n^i^g; g)fc-i 

(?l 9)l-l(g; n£l 3 (9; 9)fc+m- 2 n 

( ^- m . g)i(g ^ +2;g)2n _ 3(ag2 n + ,-l. g)j _ m 

(9; 9) 2 .- 2 (afc9 4 " +r - 5 ; 9)i(«&9 4 ^- 3 ; 9)^ + i A ' ' ffJ " ( j 
To prove this theorem, define a matrix T = (^)i>o,j>-i by 

{1 if i = and j = — 1 , 

, g( 7~ 1)J ' if i > 1 and j > 0, 
otherwise, 

and a skew-symmetric matrix B = (/?})-i<i<j by 

(a<f if i = -1 and j > 0, 
/3j = <j &A( aq r-2s+iy if < z < j and z + 1 = j, 
_ otherwise, 

where s = m — 2n + 2. A similar reasoning as in the proof of Theorem 15.21 
works to prove these identities. We omit the details. 
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6 Open problems 

In this section we formulate several conjectures for the Pfamans of certain 
sequences related to Catalan numbers based on the computer experiments. 
The Al-Salam-Carlitz polynomials [3] are defined by 

Let L be the linear functional with respect to which Un (x; q) are orthogonal. 
Then the nth moment has the expression [9j [161 EH] : 



n 

G n (a;q) = L(x n ) = J2[ 



a 

g 



k=0 

where ["1 = . \ q f\ . 
LfcJq {q;q)k(q;q)n-k 

Conjecture 6.1. Let n > 1 be an integer. Then the following identities 
would hold: 

Pff(g i - 1 -? i - 1 )G i+J - 3 (a; ? ) N ) 

^ ' l<tj<2n 

n 

= a "(™-l) g lK 2 J( 16 L™/2j 2 -l)-(-l)"4Ln/2j2-2Ln/2j.L(n-l)/2j TT (g; g)^^ (gj) 

fc=l 

a n(n-l) ? iK2j(16Ln/2j 2 -l)-(-l)»4Ln/2j 2 JJ^. g) 2fc _ 1 ^gL(«- 

fc=l fc=0 



l<»J<2n 



(6.2) 



Here |_^J denotes the largest integer which is not greater than x, and we use 
the convention that G_i(a; g) = which can in fact be assigned to any value. 

There are several well-known numbers related to lattice path enumera- 
tion ([21 [25] ). Let M n = Xlfc=o (2!)^ denote the Motzkin numbers, D n = 
Xlfc=o (fc) ( n fc fc ) the ceD t ra l Delannoy numbers, and S n = ^2=0 ("2^)^ Schroder 
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numbers. Finally, the number N(n, k) = - (™) ( J\) is known as a Narayana 
number, and 



*<«>= eKS^i 



fc 

a 



fc=0 

is known as the nth Narayana polynomial, which is the moment sequence 
of a generalized Chebyshev polynomials of the first kind. Here we use the 
convention that N Q (a) = 1. 

Conjecture 6.2. Let n > 1 be an integer. Then the following identities 
would hold: 

n-l 



Pffo , -i)M i+i _ 3 > ) =l[(4k + l), (6.3) 

V / l<ij'<2n fc=0 

Pf ((j - ijA+i-a) = 2" 2 ~ 1 (2n - 1) JJ(4A; - 1), (6.4) 

Pf ((j - 0^+,-2) = 2" a n(4fc + 1), (6.5) 

Pf ((j - i)N i+j _ 2 (a)) = a" 2 JJ(4A; + 1). (6.6) 

V / Ki,j<2n h-n 



l<i,j<2n k=0 

Note that C n = N n (l), S n = N n (2) and 



M n _! = ^ ^ j N, 

Hence, if one could prove (I6.6p . then one would have proven (16. 3 p and (16. 5p 
as corollaries. 

Let a n = ( 3 ™) = ( 3 "^ 1 )- In [II] Gessel and Xin prove that 
det(aj + j_i)i<i i j< n equals the number of (2n + 1) x (2n + 1) alternating sign 
matrices that are invariant under vertical reflection. We propose the following 
conjecture concerning this sequence. 

Conjecture 6.3. Let a n be as above. Then the following identity would 
hold: 

pf„._.x v _ 1 f r (12fc-6)!(4fc-3)!(3A;-l)! 

UJ m+3-ih<i,j<2n ~ 2 „ 11 (gA . _ 6) ; (8A . _ 3 )!( 3 jfc _ 2 )! ■ ^ 
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Appendix: Creative telescoping 

In this appendix we state an alternative proof of (I4.2p and (14. 4p by Zeil- 
berger's creative telescoping [20| 124"] . In this case the certificates are ex- 
tremely simple, and we can check the computation by hand. We note that 
one can prove (14.51) similarly, but the certificate for ( 14.51) is a little more 
complicated. 

By replacing q % by c, the equations f !4.2[) and (14. 4p are generalized as 



i„fc(k-i)+l . (abq 2k ;q)i(abg 2 ;q) k _ 2 (bq,cq k+1 ,q j k+1 ;q) k -i 

(q,aq,abcq,abqi +1 ; q) k 
(ac, abq 2 ; 



x h k (j; a, b, c, q) = - — ' ' , (6.8) 

(ag,a6cg;g)j_i 

where the sum on the left-hand side runs over odd positive integers or even 
nonnegative integers, and h k (j; a, b, c, q) is set to be 

h k (j;a,b,c,q) = (1 - q k )(l - aq k ) 



x 



|g" fc (l + abq 2k )(l + abcq^ 1 ) - ab(l + q) (cq" 1 + g^ 1 )} 
aq k -\l -b)(l- cq- k ) (l - q j ~ k ) (l - abq 2k+1 ) . (6.9) 



Let 



F fA k \ = a fc - 1 c fe - 1 gJ( fe - 1 )+ 1 . ( Q V fc ; q)i(abq 2 ; g) k ~ 2 (bq, q/c, q 1 j ; g) fc _i 

(q,aq } abcq,abqi +1 ;q) k 
x h k (j;a,b,c,q). (6.10) 

Hereafter we use the notation that F^(j, k) = F(j, 2k - 1) and F&(j, fc) = 
F(j, 2k-2). Further we set T^°\j, k) = T(j, 2k-l) and T^(j, fc) = T(j, 2fc- 
2), where 

T(j, k) = F(j, k) - , (l " ag l ( !" a6CgJ) 1 ^ (j + 1, *). (6.11) 
u ' ; W ' ; (1 - abqi +1 ) (1 - ac^" 1 ) u ' ' K ' 

Let us define P (x) (j,k), Q {x) (j,k) and R {x) (j,k) for x = o, e by P {o) (j,k) = 
P(j, 2k - 1), Q(°)(j, fc) = Q(j, 2fc - 1), fc) = R(j, 2k - 1), p( e )(j, fc) = 
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P(j, 2k - 2), g( e )(j, k) = Q(j, 2k -2), and R&(j, k) = R(j, 2 k - 2), where 

P(j, k) = a 2 c 2 q 2j {l - abq k ){l - abq k+1 )(l - bq k )(l - bq k+1 ) 
x (1 - q k /c){\ - q k+1 /c){l - q k ->- X ){l - q k ~ j ), 

Q(j, k) = (1 - g fc+1 )(l - q k+2 ){l - aq k+1 )(l - aq k+2 )(l - abcq k+l ) 
x (1 - abcq k+2 )(l - abq j+k+2 )(l - abq j+k+3 ), 

R{j, k) = (1 - abq 2k ) {W +fe+1 , q k ->-\ q^j; a, 6, c, g) 
gfc-i (1 — ag J ) (1 — abcq j ) 



— T y(a6g- J+1 ,g"- J ;g)i/j fc (j + l;a,6, c, g) j. 



(1 - a6gJ' +1 ) (1 - acqi- 1 ) 
By direct computation, we see that 

T^(j,fe + 1) _ P (x) (j, fe) P> } (j,fe + 1) 
TW(j,fc) ~QW(j,k)' R^KIJ) 

holds for x — o,e. We define ( j, fe) by 



(6.12) 



for x = o,e, where X (o) (j, fe) = X(j, 2k - 1) and X^(j, k) = X(j, 2k - 2), 
with 

— k 

X(j, k) = — — - — — . (6.14) 
1 — acq 1 1 

Lemma 6.4. Let SS x \j, k) be as above for x = o,e. Then we have 

T^(j, k) = A^(j, k + 1) - A^(j, fe) (6.15) 

for x = o, e. 

Proof. If one use ( 16. 12f) and ( 16. 13f) then ( 16. 151) reduces to the following 
identity: 

pW(j, fe)X%' fe + 1) - Q w (j, fe - fe) = R^(j, fe), (6.16) 

This can be checked by direct computation. □ 
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Because of A^ x '(j,l) = for x = o,e, 
integers, we obtain 



by summing (I6.15P over all positive 



(1 - abq j+1 ) (1 - acql" 1 ) 



$> w (j,A0 (6.17) 



(1 - aqi) (1 - abcqi) 



for x = o, e. Since -F(l, 0) = F(l, 1) = 1 and F(l, k) — for k >2, we have 



for x = o, e. Hence we obtain the desired identity (I6.8P from (I6.17p . This 
gives the second proof of Theorem 13.11 and Theorem 14.31 

References 

[1] M. Adler and P. Van Moerbeke, "Toda Versus Pfaff Lattice and Related 
Polynomials", Duke Math. J., 112 (2002), 1-58. 

[2] M. Aigner, A Course in Enumeration, Springer- Verlag, (2007). 

[3] W. Al-Salam and L. Carlitz, "Some orthogonal q-polynomials" , Math. 
Nachr., 30 (1965), 47-61. 

[4] G. Andrews, R. Askey and R. Roy, Special Functions, Cambridge Univ. 
Press, (1999). 

[5] R. Bacher, "Determinants of matrices related to the Pascal triangle" . J. 
Theor. Nombres Bordeaux, 14 (2002), 19-41. 

[6] A. Benjamin, N. Cameron, J. Quinn and C. Yerger, "Catalan Determi- 
nants — A Combinatorial Approach" , Applications of Fibonacci Num- 
bers 11, Utilitas Mathematica Publ. Co., Winnipeg (2010). 

[7] D. Bressoud, Proofs and Confirmations, Cambridge Univ. Press, (1999). 

[8] M. Ciucu and C. Krattenthaler, "The interaction of a gap with a free 
boundary in a two dimensional dimer system", Commun. Math. Phys. 
(to appear). 




(6.18) 



31 



G. Gasper and M. Rahman, Basic Hypergeometric Series (2nd ed.), 
Cambridge Univ. Press, (1990, 2004). 

I. Gessel and G. Viennot, "Determinants, Paths, and Plane Partitions", 
preprint (1989). 

I. Gessel and G. Xin, "The Generating Function of Ternary Trees and 
Continued Fractions" Electron. J. Combin. 13 (2006), R53. 

R. Gosper, "Decision procedure for indefinite hypergeometric summa- 
tion", Proc. Natl. Acad. Sci. USA 75 (1978), 40-42. 

M. Ishikawa, H. Tagawa and J. Zeng, "A g-analogue of Catalan Hankel 
determinants", RIMS Kokyuroku Bessatsu, Bll (2009), 19-42. 

M. Ishikawa and M. Wakayama, "Minor summation formula of Pfaffi- 
ans", Linear and Multilinear Alg. 39 (1995), 285-305 

M. Ishikawa and M. Wakayama, "Applications of minor summation for- 
mula, III: Pliicker relations, lattice paths and Pfaffian identities", J. 
Combin. Theory Ser. A., 113 (2006), 113-155. 

D. Kim, "On Combinatorics of Al-Salam Carlitz Polynomials", Europ. 
J. Combinatoire, 18 (1997), 295-302. 

D. Knuth, "Overlapping Pfaffians", Electron. J. Combin., 3 (1996), R5. 

C. Krattenthaler, "Evaluations of Some Determinants of Matrices Re- 
lated to the Pascal Triangle" , Seminaire Lotharingien de Combinatoire, 
B47g (2002), 19 pp. 

R. Koekoek, P. Lesky and R. Swarttouw, Hypergeometric Orthogonal 
Polynomials and Their q- Analogues, Springer- Verlag, (2000). 

T. Koornwinder "On Zeilberger's algorithm and its g-analogue", J. 
Comp. Appl. Math. 48 (1993), 91-111. 

J. Luque and J. Thibon "Hankel hyperdeterminants and Selberg inte- 
grals", J. Phys. A: Math. Gen. 36 (2003), 5267-5292. 

M. Mehta and R. Wang, "Calculation of a Certain Determinant", Com- 
mun. Math. Phys. 214 (2000), 227-232. 



32 



[23] M. Noumi, Painleve equations through symmetry, Translations of Math- 
ematical Monographs Vol. 223, American Mathematical Society, (2004). 

[24] M. Petkovsek, H. Wilf and D. Zeilberger, A = B, A K Peters, (1996). 

[25] R. Stanley, Enumerative combinatorics, Volume I, II, Cambridge Uni- 
versity Press, 1997, 1999. 

[26] J. Stembridge "Nonintersecting Paths, Pfaffians, and Plane Partitions", 
Adv. Math. 83 (1990), 96-131. 



33 



